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ABSTRACT 

'“Applied  to  two  important  classes  of  linear  complementarity  problems 
defined  by  an  n  x  n  matrix,  the  parametric  principal  pivoting  algorithm, 
using  a  suitably  chosen  (and  easily  computable)  parametric  vector,  terminates 

with  a  desired  solution  after  at  most  n  pivot  operations.  Since  each  pivot 

S<\  h 

can  be  performed  using  at  most  O(^)  arithmetic  operations,  the  total 
computational  complexity  of  the  algorithm  for  solving  these  linear 
complementarity  problems  is  no  more  than  0 (jrf3 ) .  In  one  of  the  two  classes  of 
problems  being  studied,  the  complexity  iB  0(i r)  because  the  matrix  involved 
is  5-diagonal  which  allows  each  pivot  to  be  performed  in  linear  time.  Some 
discussion  in  connection  with  Lemke's  well-known  almost  complementary  pivoting 
algorithm  is  also  addressed. 
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SIGNIFICANCE  AND  EXPLANATION 


Many  well-known  pivoting  methods  for  solving  the  linear  complementarity 
problem  have  been  shown  to  exhibit  an  exponential  computational  complexity. 

In  this  paper ,  we  identify  two  classes  of  linear  complementarity  problems 
which  can  be  solved  by  a  numerically  efficient  as  well  as  polynomially  bounded 
pivoting  algorithm.  One  of  these  classes  of  problems  arises  from  the  concave 
regression  problem  which  has  practical  applications  in  statistics.  ! 
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LINEAR  COMPLEMENTARITY  PROBLEMS  SOLVABLE  BY  AN  EFFICIENT 
POLYNOMIALLY  BOUNDED  PIVOTING  ALGORITHM 

Jong-Shi  Pang* 

1.  INTRODUCTION. 

It  is  known  that  the  general  linear  complementarity  problem  defined  by  an  arbitrary 
matrix  is  NP-ccmplete  [5].  Hence,  it  is  unlikely  that  there  will  be  a  polynomially  bounded 
algorithm  for  solving  an  arbitrary  linear  complementarity  problem.  With  respect  to  several 
most  notable  pivoting  methods,  examples  of  problems  have  been  constructed  which  show  that 
these  methods  can  require  an  exponential  number  of  pivots  [2,  12,  22].  These  cited  studies 
are  all  theoretical  in  nature  and  provide  the  worst-case  analysis  of  the  linear 
complementarity  problem.  From  a  practical  point  of  view,  it  is  more  desirable  to  be  able 
to  identify  classes  of  problems  (with  applications)  which  are  solvable  by  an  algorithm  that 
is  both  numerically  efficient  as  wall  as  polynomially  bounded.  Except  for  the  trivial  ones 
(e.g.  those  defined  by  triangular  matrices)  the  class  of  linear  complementarity  problems 
with  a  z-natrix  is  perhaps  the  beat  known  member  belonging  to  such  a  category  (4,  30]. 
(Another  related  class  can  be  found  in  (25!.)  These  latter  complementarity  problems  have 
applications  in  the  numerical  solution  of  free  boundary  value  problems,  optimal  stopping, 
isotonic  regression  and  others. 

In  this  paper,  we  identify  two  classes  of  linear  complementarity  problems  and  show 
that  with  a  suitably  chosen  (and  easily  computable)  parametric  vector,  the  parametric 
principal  pivoting  algorithm  [6,  27]  will  compute  a  solution  after  at  most  n  pivot 
iterations  where  n  is  the  order  of  the  matrix  defining  the  complementarity  problems,  (hie 
such  class  arises  from  the  concave  regression  problem  which  has  practical  applications  in 
statistical  regression  analysis.  The  latter  problem  was  first  formulated  by  Hildreth  (13] 
for  the  estimation  of  marginal  productivity  curves  and  is  concerned,  in  general,  with 
finding  a  least-square  estimate  of  a  certain  functional  relationship  between  some  dependent 
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•nd  independent  variables  which  is  known  to  be  concave.  Recent  references  on  the  concave 
regression  problem  include  (11,  14,  31].  The  resulting  class  of  linear  complementarity 
problems  is  defined  by  a  5-diagonal  symmetric  positive  definite  but  non-Z  matrix.  The 
5-diagonal  structure  greatly  simplifies  the  practical  Implementation  of  the  parametric 
principal  pivoting  algorithm  which  results  in  an  efficient  0(n2 )  method  for  solving  the 
concave  regression  problem. 

The  primary  reason  why  a  great  deal  of  emphasis  ia  placed  on  the  concave  regression 
problem  is  because  it  is  this  practical  problem  which  has  challenged  us  to  develop  an 
algorithm  that  ia  both  numerically  efficient  and  polynomial ly  bounded  and  has  subsequently 
led  us  into  this  entire  study.  The  desire  to  derive  such  a  fast  algorithm  is  in  turn 
motivated  by  a  close  relative  of  the  concave  regression  problem,  namely,  the  Isotonic 
regression  problem.  This  latter  problem  has  been  well  studied  in  statistics  [1]  and  a 
linear-time  algorithm  has  been  developed  (1?,  31].  From  a  complementarity  point  of  view, 
the  isotonic  regression  problem  can  be  formulated  as  a  linear  complementarity  problem  with 
a  tridiagonal  Stieltjea  matrix  and  thus  its  solution  by  a  linear-time  algorithm  is  to  be 
expected  (4,  9,  10].  On  the  other  hand,  as  we  shall  see,  the  matrix  defining  the  linear 
compleMntarity  problem  arising  from  the  concave  regresaion  problem  is  not  Z. 

The  other  class  of  linear  complementarity  problems  identified  in  this  paper  consists 
of  those  defined  by  a  matrix  whose  transpose  is  hidden  Minkowski.  A  hidden  Minkowski 
matrix  is  a  P-matrix  which  is  hidden  Z.  The  class  of  hidden  z-matrlces  was  introduced  by 
Mangasarian  [20]  in  connection  with  the  study  of  solving  linear  complementarity  problems  as 
linear  programs  (see  also  [8]).  The  name  'hidden  Z"  was  coined  because  of  the  relation  to 
a  hidden  Leontief  matrix  (23].  Specifically,  a  matrix  M  is  hidden  Z  if  there  exist 
Z-matrices  X  and  Y  such  that  the  two  conditions  below  are  satisfied 

MX  -  Y  (1) 

rTX  *  stY  >  0  for  seme  r,s  >  0  .  (2) 

Obviously,  a  Z-matrix  is  hidden  Z.  Many  basic  properties  of  a  hidden  Minkowski  matrix 
have  been  obtained  in  [24].  In  particular,  it  is  known  that  an  H-matrlx  with  positive 
diagonals  is  hidden  Minkowski.  (A  matrix  M  is  H  if  its  comparison  matrix  H  defined 
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ia  P.)  Examples  of  H-aatrices  includa  tha  column  (or  row)  atrictly  diagonally  doailnant 
■aatricaa  and  of  courae  tha  Minkowski  aiatricaa.  Othar  axaatplaa  of  hiddan  Minkowski  matrices 
can  bo  found  in  (241.  Sine*  tha  tranapoaa  of  an  H-matrix  ia  obvioualy  an  H-matrix,  it 
follows  from  our  analyaia  that  a  linaar  caaplaaantarity  problaa  dafinad  by  an  H-matrix  with 
poait ive  diagonals  can  b«  aoived  by  an  af fectiva  0(n3)  pivoting  algorithm.  In 
particular,  ao  can  a  problaa  with  a  atrictly  diagonally  dominant  aatrix  having  poaitiva 
diagonal  ontriaa. 

Although  Mangaaarian  (20]  haa  ahown  that  a  linear  coaplaaantarity  problaa  with  a 
hidden  Z-aatrix  can  bo  aoived  by  a  linaar  prograa  (ualng  an  aaaily  computable  objective 
function) ,  tha  only  polynoaially  bounded  algorithm  for  aolving  a  general  linear  prograa 
(16]  ia  known  to  be  numerically  inefficient  (3).  the  parametric  principal  pivoting 
algorithm,  on  the  other  hand,  haa  been  ahown  to  exhibit  good  numerical  performance  even  on 
problema  of  fairly  large  aiae  (28,  29]. 

The  question  of  efficiently  identifying  tdiethar  an  arbitrary  aatrix  la  hidden  Z 
reaaina  unsolved.  (Basically,  the  difficulty  has  to  do  with  the  nonlinearity  of  the  second 
defining  condition  (2).)  However,  that  of  checking  if  a  aatrix  is  hidden  Nlnkowaki  can  be 
effectively  answered  by  solving  two  linear  programs  [26].  The  procedure  described  in  the 
cited  reference  will  find  the  two  z -matrices  X  and  Y  satisfying  (1)  and  (2)  if  N  is 
indeed  hidden  Minkowski.  For  certain  subclasses  (like  the  B-matrices  with  positive 
diagonals),  the  aatrices  X  and  Y  can  be  obtained  easily  without  aolving  any  linear 
prograa  (see  [8,  20,  24]  for  more  such  subclasses).  Ralated  to  this  discussion  is  the  open 
question  of  whether  the  transpose  of  a  hidden  Z-aatrix  is  hidden  Z. 

The  organisation  of  the  remainder  of  this  paper  is  as  follows.  In  the  next  section, 
we  give  a  quick  review  of  the  parametric  principal  pivoting  algorithm  for  solving  a  linear 
complementarity  problaa  with  an  n  *  n  P-matrix  and  state  a  general  (sufficient)  condition 
under  which  the  algorithm  will  terminate  with  the  desired  solution  after  at  moat  n 
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pivots.  Ns  also  discuss  an  afficiant  implementation  of  the  algorithm  when  the  condition  ia 
satisfied  and  establish  its  O(n^)  computational  complexity.  Section  3  deals  with  the 
concave  regression  problem.  He  show  how  this  practical  problem  can  be  formulated  as  a 
special  linear  ccmplaswntarity  problem  and  demonstrate  that  the  condition  guaranteeing  the 
linear  termination  of  the  paraMtric  principal  pivoting  algorithm  is  indeed  satisfied  by 
this  special  problem.  In  Section  4.  we  study  a  general  linear  complementarity  problem 
defined  by  a  P-matrix  whose  transpose  is  hidden  Z  and  ahow  that  the  same  sufficient 
condition  on  the  parametric  principal  pivoting  algorithm  ia  also  satisfied  by  this  class  of 
problems.  Finally,  in  the  fifth  and  last  section,  we  extend  our  discussion  to  Lemke'a 
almost  complamsntary  pivoting  algorithm  [18,  19]  and  show  that  the  same  condition  given  in 
Section  1  is  also  sufficient  for  Leake* s  method  to  terminate  in  at  moat  n  +  1  pivots  with 
a  desired  solution  when  applied  to  a  general  linear  complementarity  problem  with  an 
n  x  n  nondegenerate  matrix. 
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2.  T!«  PARAMETRIC  PRINCIPAL  PIVOTING  ALGORITHM 


Ha  find  It  useful  to  quickly  review  the  parametric  principal  pivoting  algorithm  In 
terms  of  Its  practical  Implementation  (6,  27].  Given  the  linear  complementarity  problem 
(LCP) 

y  *  q  +  «x  i  0,  x  *  0,  yTx  -  0  (3) 

where  the  matrix  M  is  P,  we  augment  it  by  a  parametric  vector  p  and  consider  the 
parametric  LCP 

y»q  +  0p+Mx2O,  x  i  0,  yTx  ■  0 

where  6  is  a  parameter  to  be  driven  to  sero.  The  vector  p  is  chosen  positive.  Assume 
that  several  (principal)  pivots  have  been  performed.  Let  L(K)  denote  the  currently  basic 
(nonbasic)  x-variables.  (Initially,  L  -  4.)  With  respect  to  these  index  sets,  the 
canonical  tableau  may  be  written  in  the  form 


-1 

«1 

\  - 

% 

PL 

«LL 

'hll"ijc 

* 

where  (qL,  p^)  is  the  (unique)  solution  to  the  system  of  linear  equations 

"LL<*L.PL>  *  "^L'Pl1 


and 


♦  iScl<5l'Pl>  . 

and  where  (M/M,,  )  denotes  the  Schur  complement  of  M,,  in  M> 

<**LL>  -  -  «KL«£i«LK  * 

(See  (7]  for  various  properties  of  the  Schur  complement.) 

To  determine  the  next  pivot,  the  rstio  test  is  performed: 

S  »  max{-q1/pi  1  pA  >  0}  .  (4) 

If  p  <  0  or  5  <  0,  then  the  desired  solution  to  the  original  LCP(3)  is  obtained  as 

**  •  (qt,0)  . 

Otherwiee,  let  k  be  a  maximizing  index  in  (4),  Update  the  index  set  L  (and  its 


complement  K)  by  the  rules 

*“new  ”  Lold\  «  *  •  Lold 

LoldU{k)  if  k  *  Lol(J  . 

This  completes  one  (pivot)  iteration  of  the  algorithm. 

Now  suppose  that  the  vector  p  is  chosen  so  that 

MLLPL  -  °  tor  a11  L  '  (5) 

Then  the  maximizing  index  k  can  never  occur  in  Thus  the  cardinality  of  the  set 

L  is  increasing  by  one  at  each  pivot.  Consequently,  unless  the  algorithm  has  already 
terminated  (with  a  desired  solution) ,  it  will  continue  until  the  complement  K  reaches 
empty,  at  which  point,  we  have  p  *  -m” 'p  £  0  and  the  algorithm  terminates.  We  have 
therefore  proved 

Theorem  1 .  Let  M  be  a  P -matrix  of  order  n.  If  there  exists  a  vector  p  >  0  such  that 
condition  (S)  holds,  then  the  paraaietric  principal  pivoting  algorithm,  using  p  as  the 
parametric  vector,  will  compute  a  solution  to  the  LCP(3)  in  at  most  n  pivots. 

Remarks,  (i)  No  nondegeneracy  assumption  la  needed  in  Theorem  1. 

(ii)  Underlying  the  proof  of  Theorem  1  is  the  key  idea  that  once  an  x-variable 
becomes  basic,  it  will  stay  basic  until  termination.  Loosely  stated.  Theorem  1  asserts 
that  all  the  basic  x-variables  can  be  identified  in  no  more  than  n  pivot  steps.  Of 
course,  once  those  variables  are  determined,  the  desired  solution  to  (3)  is  readily 
obtained. 

Based  on  the  idea  pointed  out  in  Remark  (ii)  above,  it  is  possible  to  simplify  the 
implementation  of  the  parametric  principal  pivoting  algorithm.  Indeed,  since  a  basic 
x-variable  can  not  become  nonbasic  again,  we  need  to  keep  track  of  the  nonbasic 
components  (qy.Py)  only  and  restrict  the  ratio  comparisons  (4)  to  such  components. 
Moreover,  exploiting  the  fact  that  the  index  set  K  decreases  by  one  element  k  (the 
maximizing  index)  at  each  pivot,  we  may  update  these  nonbasic  components  by  the  following 
recursive  formula  which  does  not  require  the  knowledge  of  the  basic  components i 


'V'V'new  *  'V'V’old  +  (V  -  MK'LSLk,(qk'Pk) 
where  K’  »  K\{k)  and  is  the  solution  to  the  system  f  linear  equations 
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*LL*Lk  “  *4* 

(The  formulas  (61)  and  (611)  ara  aaay  to  varlfy . ) 


(611) 


Susmarising  the  discussion,  we  give  below  a  atep-by-atep  impl amenta t ion  of  the 
paraaMtric  principal  pivoting  algorithm  for  aolving  the  LCPO ) ,  assuming  that  a  vector  p 
hea  been  choaen  aa  specified  in  Theorem  1. 

Step  0.  (Initialieation)  Set  L  »  4  and  K  ”  (1,...,n).  Set  p  *  p  and  q  «  q. 

Step  1.  { Termination  Teat)  Determine  the  critical  value 

f  -  nax{-q^/p^  i  i  «  It  and  PA  >  0}  .  (4)* 

If  p^  <  0  or  8  <  0 ,  go  to  Step  3.  Otherwise ,  let  k  (  K  be  a  maximising  index. 

Step  2.  (Update  of  the  Nonbeaic  Components)  If  X  -  {k),  aet  X  ■  +  and  L  -  {1,...,n}, 

go  to  Step  3.  Otherwise,  solve  the  system  of  linear  equations  (6ii)  and  compute  (61). 

Set  X  «  X*  and  L  •  l  u  {k}.  Go  to  Step  1. 

Step  3.  (Output  of  Solution)  Solve  the  system  of  linear  equationa  for  x£i 

*uA  "  • 

The  vector  x*  ■  (x£,0)  is  the  unique  solution  to  the  ICP  (3).  Stop 

The  success  of  the  above  algorithm  clearly  hinges  on  the  ability  to  find  the  crucial 

vector  p.  Continuing  to  assume  that  it  is  available,  we  analyse  the  complexity  of  the 
algorithm.  Step  1  requires  0(n)  comparisons.  By  using  an  adaptive  matrix  factorisation 
(such  as  LU)  scheme,  the  system  (6ii)  can  be  solved  in  0(n2)  tine,  so  can  the  one  in 
Step  3.  The  computations  in  (61)  can  be  achieved  in  the  same  amount  of  time.  Since  the 
algorithm  will  terminate  after  at  most  n  passes  through  Steps  1  and  2  and  since  the 
storage  requirement  is  obviously  no  more  than  0(n2),  the  overall  complexity  becomes 
0(n3).  If  the  matrix  M  is  banded  with  small  width  (such  as  the  one  to  be  analysed  in  the 
next  section),  both  Steps  2  and  3  can  be  carried  out  in  lineer  time  (even  without  any 
adaptive  procedure).  In  this  case,  the  complexity  reduces  to  0(n2). 

Remarks,  (i)  The  above  complexity  analysis  assumes  that  the  systems  of  linear  equations 
(6li)  are  solved  by  a  direct  method  (such  as  Gaussian  elimination).  For  problems  of  very 
large  else  (say  when  n  is  a  few  thousands),  it  nay  be  more  advantageous  to  solve  such 


system  by  iterative  Methods  (like  SOR).  In  this  case,  the  analysis  would  not  be 
applicable  because  of  the  infinite  nature  of  the  iterative  schemes . 

(ii)  The  implementation  given  above  ignores  the  basic  components  ( qL , )  until 
termination  actually  occurs.  If  for  some  reason  they  are  needed,  they  can  be  obtained 
recursively  from  the  following  formulas: 

l^L'PL>new  “  (^L'PL>old  "  MLk(5k»Pk>  new 

new  *  _(^k'Pk)old/'{Mkk  "  Mkl/*Lk)  * 
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3.  THE  COWCAVg  REGRESSION  PROBLEM . 

In  this  »«ct ion,  we  study  the  concave  regression  problem  [31]  and  show  that  when  it  is 
formulated  as  the  LCP(3),  the  vector  p  of  all  ones  will  satisfy  the  required  properties 
in  Theorem  1.  Thus,  the  analysis  of  Section  2  applies  and  we  obtain  an  effective  0(n2> 
algorithm  for  solving  the  concave  regression  problem. 

Given  an  integer  nil,  data  points  {a^}"*2,  scalars  with  <  ai+1 

ti  «  1,...,n  +  1)  and  weights  {w^}"*2  with  w^  >  0  (i  -  1,...,n  +  2),  the  concave 
regression  problem  is  to  find  numbers  {u^}"*2  to 

n+2  2 

minimize  I  wi^ui  ~  ai^  (7) 


subject  to 

ui+1  ~  Ui  <  Ui  ~  ui-1 
“i+1  “  °i  *  “i  "  “i-1 


ti 


2,...,n  +  1)  . 


The  constraints  above  express  the  fact  that  the  consecutive  slopes  of  the  line  segments 
joining  the  points  ^ai'ui^iti  *ln  the  Plan®)  are  non-increasing,  i.e.  the  piecewise- 
linear  curve  connecting  those  n  +  2  points  is  concave. 

To  write  (7)  in  matrix  form,  let  W  be  an  m  x  m  diagonal  matrix  with  weights 
as  the  diagonal  entries  (m  "  n  +  2).  Define  the  positive  scalars 

Bi  "  1/(°i+1  -  V  1-1 . .  +  1 

and  let 


-s. 


61  +  B2 

-B„ 


”®2 

®2  *  ®3 


-B  a  +  8  .  -6  . 

pn  n  n+1  n+1 


be  the  n  *  m  matrix  of  the  concavity  constraints  in  (7).  We  may  now  restate  problem  (7) 
as  to  find  a  vector  u  e  R?”  to 
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minimize  V2  u^Wu  -  u^Wa 
subject  to 


(7) 


Au  £  0  . 

The  Karush-Kuhn-Tucker  conditions  of  (7)*  are 

0  =  -a  +  u  -  W~'aTx 
y  =  Au  £  0,  x  £  0,  ytx  m  0  . 

Eliminating  the  vector  u,  we  obtain  the  LCP 

y  =  Aa  +  AW-1ATx  £  0,  x  £  0,  yTx  -  0  .  (8) 

Obviously,  if  x*  solves  the  above  LCP,  then  the  vector 

u*  =  a  +  W_1Atx* 

solves  the  concave  regression  problem  (7). 

It  is  easy  to  see  that  the  matrix  A  has  full  row  rank.  Thus  the  matrix 

M  =  AW-1AT  (8)' 

defining  the  LCP(8)  is  symmetric  positive  definite.  Moreover,  M  is  a  5-diagonal  matrix 

(i.e.  a  band  matrix  of  width  5)  and  its  entries  have  the  sign  pattern 

+  -  + 

-+-  + 


i  *  :  *  :J  • 

Thus  M  is  not  Z.  (We  do  not  know  if  M  is  hidden  Z  or  not.) 

Theorem  2 .  Let  M  be  given  by  (8)'.  Then  condition  (5)  holds  if  p  is  chosen  as  the 

vector  of  all  ones.  Consequently,  the  conclusion  of  Theorem  1  applies  to  the  LCP(8). 

The  proof  of  Theorem  2  is  by  induction  on  the  cardinality  of  the  index  set  L.  For 

this  purpose,  we  derive  some  properties  of  the  matrix  M  defined  above. 

Since  M  is  completely  determined  by  the  scalars  {S^,w^},  we  shall  say  that  M  is 

of  type  ( {8 . }?+ ! ,{w, }n*^j .  We  say  that  a  matrix  M'  is  of  the  same  type  as  M  if  M‘ 

"  i  1»  1  i  i-l 

is  defined  by  some  positive  scalars  {8^}”^*'  and  {w^)"_^  ih  ^he  8arae  way  as  W  is 
by  and  ^wi^i-i  '  Obviously,  if  is  a  principal  submatrix  of  M  consisting 


of  consecutive  rows  and  columns,  then  mLL  If  of  the  same  type  as  M.  Indeed,  if 

I*  ”  ( j ,  j  +  +  k}  , 

then  Hll  Is  of  type  <  {Bl*i-j+1 '  {“i^**2** 

By  the  k-th  forward  (backward)  leading  principal  subnatrix  of  M,  we  mean  the 
submatrix  consisting  of  the  first  (last)  k  rows  and  k  columns.  The  following  few 
lemmas  establish  certain  invariance  properties  of  the  Schur  complements  of  leading 
principal  subautrices  in  M.  They  are  all  stated  in  terms  of  forward  leading  principal 
submatricea.  Similar  results  hold  for  backward  leading  principal  submatrices.  The  first 
lemma  says  that  the  Schur  complement  of  in  H  is  of  the  same  type  as  M.  Moreover, 

the  scalars  defining  this  Schur  complement  are  not  much  different  from  those  defining  M 
and  can  be  obtained  easily  from  some  simple  expressions. 


Lecma  1.  The  Schur  complement  (M/M^j)  is  of  type 


<(B2.  -3.  Vi-4» 


I2  -  B1B2(w;181  ♦  w”1  (B,  ♦  e2»/(w ♦  -^(8,  ♦  B2)2) 


Mn/(w*1(w‘1B2  +  wj^lB,  +  82»> 


-3  *  *  w2,<81  +  b2,2)>  • 


Proof.  This  follows  from  a  straightforward  computation  of  (H/Mj 1 ) . 

Generalizing  Lemma  1,  we  have 

Lemma  2.  Let  Ny  denote  the  k-th  forward  leading  principal  submatrix  of  M.  Then  the 
Schur  complment  (M/Nk)  is  of  type 

(  ^8k+1'^Bi^i-k+2^'^wk+1'wk+2'  *wi*i-k-*-3*  * 
for  some  suitable  scalars  wk+1  and  Wk+2* 

Proof.  This  can  be  proved  by  induction,  utilizing  Lemma  1  and  the  fact  that 

<M/Nk)  -  (fi/S^.,) 

where  R  »  (M/M^)  and  denotes  the  (k-l)-st  leading  principal  submatrix  of  H. 
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Lemma  3 .  Let  Mr,,  be  a  principal  submatrix  of  M.  Let  be  the  k-th  forward  leading 

principal  subamtrix  of  M^.  Then  the  Schur  complement  (M^/N^)  ie  a  principal  submatrix 
of  seme  matrix  M'  of  the  same  type  as  M. 

Proof.  By  means  of  an  inductive  argument,  like  the  one  used  in  Lemaui  2,  it  suffices  to 
prove  for  k  «  1.  If  HLL  consists  of  consecutive  rows  and  columns  from  M,  then 
is  itself  a  matrix  of  the  same  type  as  M  and  thus  the  conclusion  follows  from  T  sews  1. 

On  the  other  hand,  if  some  rows  (and  columns)  in  KLL  are  not  consecutive,  we  may  fill  in 
thoee  missing  rows  and  columns  to  get  a  larger  principal  submatrix  H^'L'  with  L  £  L' • 
Then  (H^/Cll^j  1 )  is  a  principal  submatrix  of  (Mt  «,  i/(H, t  )t1)  which  by  Lemma  1  again, 
is  a  matrix  of  the  same  type  as  M. 

The  following  lemma  is  easy  to  see.  It  allows  us  to  perform  some  scaling  operation  in 
the  main  inductive  proof  of  Theorem  2. 

Lemma  4 .  Let  N  be  obtained  from  the  matrix  M  by  deleting  its  second  row  and  second 

column  and  then  scaling  the  first  row  and  the  first  column  by  a  positive  scalar  6  (the 

2 

(1,1 ) -entry  is  thus  scaled  by  <  ) .  Then  N  is  equal  to  the  principal  submatrix  obtained 
from  the  matrix  M'  by  deleting  its  second  row  and  second  column  where  M'  If  of  type 

Remark,  we  should  point  out  that  if  we  perform  the  same  scaling  operation  to  the  matrix 
M  itself,  the  resulting  matrix  will  not  be  of  the  same  type  as  M. 

In  [31],  it  was  proved  that  if  the  set  of  data  points  is  convex,  then  the 

least-square  concave  fit  must  be  a  straight  line.  This  interesting  geometric  fact  has  an 
important  algebraic  consequence,  namely,  that  the  inverse  of  the  matrix  M  is 
nonnegative.  To  see  this,  we  translate  the  geometric  statement  in  the  context  of  the 
LCP(8),  obtaining  the  implication) 

Aa  i  0  -»>  y*  -  Au*  ■  0 

which  is  equivalent  to 

Aa  i  0  — >  x»  -  -(AW-1AT)_1Aa  *  0  . 

Since  the  matrix  A  has  full  row  rank,  the  above  implication  is  in  turn  equivalent  to 
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y  2  0  —  >  (xtf-1AT>-,y  i  0 


thus  M- 1  i  0. 


As  a  matter  of  fact,  a  stronger  version  of  the  above  conclusion  holds. 


5.  Let  {B^^J  and  be  positive  scalars.  fl>en  a  aatrix  M  of 


» n+2 


type  *  positive  inverse. 

Notice  that  Lemsui  5  does  not  follow  free  the  preceeding  argument.  In  what  follows, 
give  a  proof  based  completely  on  eatrix  manipulations.  By  letting  W  be  the  n  *  n 
diagonal  matrix  of  the  scalars  {w^} and 

“®* 


®2  *  ®1 

-8, 


®3  +  ®2 


-8 


-8, 


n-1 


8  +  8  , 
n  n- 1 

-B_ 


n 

8_  ♦  8 


n+1 


be  obtained  from  a  by  deleting  its  first  and  last  columns.  It  is  easy  to  see  that 

H  -  BN-1.1  ♦  ♦  ’CjB^Vn  <»> 

where  e^  and  en  are  the  first  and  last  unit  vectors  in  r".  The  above  formula  (9) 
identifies  the  matrix  M  as  a  simple  rank-two  update  of  BN^B7.  Notice  that  B  is  an 

irreducibly  diagonally  dominant  Stieltjes  matrix.  Thus  B  has  a  nonnegative  inverse,  and 
—  1  T 

so  does  BN  B  .  The  next  result  gives  an  explicit  inverse  for  B  which  is  needed  to 
prove  Lame  5. 

Lemma  6.  Let  n  •  n  ♦  2  and  8,  “  1/(ai+,  "  1  “  1, 


,n  ♦  1.  Then 


«*2  “  a1)<am  ”  V  (a2  ”  a1)<am  "  a3>  *  •  *  (o2  “  a1,,an  “  Vl1 

(«2  -  V«iB  *  B3>  la3  ’  V(an  '  V  •  *  *  (a3  ”  a1,<am  *  Vi1 


(a2  ‘  a1,(am  *  “m-l*  <a3  “  a1)(<*m  '  ®m-1>  •  •  *  «*m-l  “  “  “srl1 


Proof,  •nils  can  be  verified  by  directly  multiplying  out  BB”1. 
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Remark.  IMH  6  is  believed  to  have  ita  own  lntaraat .  For  example,  it  provides  an 
explicit  invar a#  for  tha  matrix 


2 

-1 


-I 


2 

-1 


-1 

2 


which  occur*  vary  often  in  tha  discretization  of  elliptic  partial  differential  equations* 
In  order  to  establish  lemma  5,  we  first  show  that  a  certain  entry  of  H"1  is 
positive. 

Lemma  7.  (M_1)1>n  >  0. 

Proof.  Applying  the  Sheraan-Morrison-woodbury  formula  [IS,  p.  124]  to  (9),  we  obtain 


-1 


<BW 


V) 


-1  -  (v;1* 


„  -T 
B,e.  ,w 


Vi5!’ 


^*2  + 


w,  8,0, 

w‘^8  +,.T 
m  n-M  n 


w'^b,;, 

’V^nvl'n 


where 


(«,.«)  -  <BSr,BT)"\e,,e  )  . 

in  In 


Define  three  scalars 

-1  m-1 

k“2  "  "  k-2 

Then,  by  Lemma  6  and  an  easy  manipulation,  we  obtain 

(a,  -  a, )(o_  -  a _ , ) 


m-l  m-i  2  m-1  2 

Y  ’  .  L  Vak  *  “l,(a«  *  V'  *  “  _L  VB.  '  v  *nd  °  “  J2  W,t<“k  ■  *,)  ’ 


-  1  T  <.1 

(M  >1,n“*1M  *n 


2  “1  ‘ 


<*»- V 


—  [y  -  («.y)g_1(y)) 


where  G  la  the  2*2  positive  definite  matrix 

m  ’  V2 

Y 


S  +  w.  (a  -  a, ) 

»  BJ  1 


o  +  w  (a  -  a.) 

W  B  i 
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By  the  Schur  determinants!  formula  ( see  {?)).  we  deduce 


(m’1) 


1,n 


(«2  -  a,>  (tta  -  y,) 

(aB  -  a,)2 


dat  R 
dat  G 


where  R  la  the  3x3  matrix 


R  - 


Y 

Y 
o 


Obviouely , 


dat  R  -  w.w  (a  -  a.)*Y  >  0  . 

1mm  1 

Thus,  >  0  as  desired. 

Proof  of  Leasui  5.  We  uae  Induction  on  n,  which  is  the  order  of  the  matrix  M.  It  is 
obvious  that  the  assertion  is  true  for  n  «  1.  Suppose  that  it  is  true  for  k  <  n.  Let 
M  be  a  matrix  of  type  *  ^i^i-1 '  ^Wi^i-1  *  *  **  ma>'  write 


where  N  la  the  (n  -1)-st  backward  leading  principal  subaatrix  of 

is  of  the  earns  type  as  m.  Thus, 
5  “  is  positive.  We  have  (see 


1,  the  Schur  complement 
hypothesis  implies  that 


K.  Recording  to  Lemma 
the  induction 
(71  e.g. ) 


M 


-1 


1 


-N  a 


T--1 

-a*N 

«N 


) 


where  4  ■  (M/N).  Since  M  is  positive  definite,  6  >  0.  Consequently,  with  the  possible 
exception  of  the  second  to  last  entries  in  the  first  row  and  first  column,  M” *  is 
positive.  Similarly,  applying  the  same  argument  to  the  partitioning 


where  N1  is  the  (n  -  1)-st  forward  leading  principal  submatrix  of  M,  we  can  deduce 
thet  with  the  possible  exception  of  {M—1 > 1 ,nd  *M*''n,1'  (these  latter  two  entries 
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u«  aqua!  because  M  ia  symmetric)  M- 1  ia  poaitiva.  By  Imam*  1,  it  thua  follows  that 
M” 1  has  all  antrlas  poaitiva.  This  completes  tha  proof. 

No  ara  now  raady  to  prova  tha  aain  lhaoraa  2. 

Proof  of  TTiaoran  2.  Ha  usa  induction  on  tha  cardinality  of  L.  Tha  aaaartion  ia  aaaily 
aaan  to  hold  for  L  consisting  of  no  more  than  2  indicaa.  Supposo  that  tha  concluaion  ia 
trua  for  all  L  consisting  of  no  aora  than  k  -  1  (k  i  3)  indicaa.  Lat  L  bo  an 
arbitrary  subsat  of  {l,...,n}  with  k  alaaents.  We  may  partition  tha  matrix  W,T  in 
tha  following  wayt 


whore  each  consiats  of  consecutive  rows  and  saaa  columns  of  H  and  each  ia 

either  identically  saro  or  has  all  antriaa  equal  to  aero  except  for  tha  single  one  in  the 
upper  right  corner  which  ia  positive.  (In  other  words,  wa  partition  the  eat  L  into 
disjoint  groups  fl^)^  where  indices  in  each  ara  consecutive.)  If  consiata 

of  just  one  single  block  Nj  (i.a.  if  the  indices  in  L  ara  all  conaacutiva) ,  than 
KjPy  *  0  because  MLL  is  of  the  same  type  aa  M  and  Loom  5  applies.  So  suppose 
that  M,t  consists  of  aora  than  ons  such  block  . 

If  at  least  one  is  identically  sero  (i.e.  if  the  last  index  in  at  least  one 

group  differs  by  three  or  more  from  the  first  index  in  the  immediately  following 

group  Li+1 ) ,  then  the  system  of  linear  equations 

“i A  ■  ,10) 

decomposes  into  two  saialler  subsystems)  therefore  tha  positivity  of  PL  follows  from  our 
induction  hypothesis.  So  suppose  that  all  have  exactly  one  positive  entry  in  the 

upper  right  corner  (i.e.  suppose  that  the  last  index  in  aach  group  is  exactly  two  lass 

than  the  first  index  in  the  immediately  following  group  ^ 
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Aeeuwe  that  the  firat  leading  block  Nt  is  or  order  k  >  1.  We  way  write 


■i-ti  > 

a  o 

where  8,  ia  tha  (k*  -  1  >-«t  forward  leading  principal  aubutrix  of  N|<  Writ# 


?,"(/)  “d  P,  -  (,’) 


L  pt 


according  to  the  partitioning  of  and  Nj.  Pivoting  on  81  in  tha  ayataa  (10)  yialda 

tha  raducad  ayataai 

*  qT 


Q,  k2  o2 


°t-2  "t-1  <5-1 

fit-1  "t 


• 

r 

e 

P2 

- 

P2 

• 

a 

• 

a 

• 

• 

Vi 

Pt 

J 

pl-1 

pl 

(11) 


where  S  -  (H^/5^ )  and  ia  tha  laat  coluan  of  Qv  Hie  acalar  a  -  1  -  a  ■1  p1  ia 
poaitive  by  induction  hypothaaia.  Scaling  tha  firat  row  and  firat  coluan  in  tha  ayataai 
(11)  by  1/a,  wa  obtain 


°t-2  Vi 
V 


*t-1 


i-1  "t 


er 

i 

P2 

m 

P2 

• 

• 

* 

• 

Vi 

Vi 

Pt 

(12) 


By  Leaoia  4,  tha  autrix  defining  tha  ayataai  (12)  ia  a  principal  aubaiatrix  of  a  Matrix  of  tha 
aaaia  type  aa  M.  Thua  induction  hypothaaia  iapliea  that  r  >  0  and 
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f 

I 


r 


! 

i 


i 


Pt  >  0  (i  -  2, . . . , t) .  To  ahow  p1  >  0,  we  perform  a  backward  principal  pivot  on  tha 
aacond  to  laat  blocks  in  tha  system  ( 1 o )  obtaining 


(N;  j(Pi)  ■  (!’) 

a  or  ■ 


whara  &  is  tha  Schur  complement  of 


in  tha  matrix 


Q2  n3  Oj 


flt-2  "t-1  °*-1 

°t-1  "* 


°t-2  Vi  Vi 
Vi 


(13) 


and  the  scalar  a  is  positive  by  Induction  hypothesis.  By  Leasm  3,  it  can  be  seen  that 
the  matrix  defining  the  system  (13)  is  of  the  same  type  as  M  and  thus  has  a  positive 
inverse  (Lemma  5).  Therefore  p^  >  0. 

Now  suppose  that  the  block  consists  of  just  one  single  entry.  If  tha  second 

block  n2  also  consists  of  one  single  entry,  then  pivoting  on  Nj  in  tha  system  (10) 
gives  the  reduced  system 


r  -  t 

’  mm 

.  m 

2  °2  T 

P2 

■ 

p2 

«2  "3  «3 

• 

P3 

•  a 

•  • 

* 

‘  T 

°l-2  Vi  V, 

Pl-1 

Vi 

Vi 

Pf 

,PI  . 

where  p2  >  0.  Scaling  the  first  row  and  first  column  of  the  system  by  1/p2>  we  obtain 
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By  Lemma  4  again,  the  matrix  defining  the  above  aysten  ia  a  principal  subaatrix  of  som 
matrix  of  the  aame  type  aa  M.  Thua,  the  inductive  hypotheaia  impliea  p^  >  0 
(i  _  2,...,t).  To  show  p.  >  0,  perform  a  principal  pivot  on  the  third  to  laat 
block  N ^ ( i  -  in  the  aysteo  (10)  (aince  both  N1  and  N2  are  aingle-entry 

blocka  and  L  has  k  2  1  entires,  there  must  be  at  least  one  block  NA  (123)), 
obtaining  a  2x2  system  from  which  the  positivity  of  p1  follows  easily. 

Finally,  suppose  that  the  second  block  Nj  is  of  order  larger  than  1,  Then  writing 


«2*(t 

b 


and  applying  an  argument  similar  to  the  one  used  when  N 1  is  of  order  larger  than  1,  we 
can  easily  deduce  that  p.  >  0  as  desired. 

la 

Suamtarizing,  we  always  have  p  >  0  for  any  index  set  L.  This  completes  the  proof. 

Ii 

Remark.  The  reason  why  the  scaling  in  the  systems  (12)  and  (14)  is  needed  is  because  the 
induction  hypothesis  is  applicable  only  when  the  right-hand  vector  in  (12)  and  (14) 
consists  of  all  ones. 


4.  THE  CASE  Of  A  HIDDEN  MINKOWSKI  MATRIX. 


Returning  to  the  general  LCP ( 3 ) ,  we  prove 


Theorem  3.  Suppose  that  M1  ia  hidden  Minkowski.  Let  X  and  Y  be  two  Z -matrices 
satisfying 


rTX  ♦  stY  >  0  for  some  vectors  r,s  i  0  .  (15ii) 

Then  condition  (5)  holds  for  any  vector  p  >  0  satisfying  XTp  >  0.  Consequently,  the 
conclusion  of  Theorem  1  applies  to  the  LCP (3). 

Before  proving  Theorem  3,  we  compare  it  with  the  results  obtained  in  [8,20]  concerning 
the  solvability  of  an  LCP  with  a  hidden  Z -matrix  as  a  linear  program.  Let  M,X,Y  and  p 
be  as  given  in  Theorem  3.  Then  the  (unique)  solution  to  the  LCP 

y  -  q  ♦  MTx  l  0,  1)0  and  yrx  •  0  (16) 

can  be  obtained  by  solving  the  LP 

minimise  pTx 

subject  to  q  ♦  MTx  )  0  and  <  )  0  . 

Theorem  3  implies  that  the  name  vector  p  can  be  used  to  start  the  parametric  principal 
pivoting  algorithm  for  solving  the  LCP 

y  ■  q  ♦  Mx  i  0,  x  *  0  and  yTx  *  0  (3) 

and  the  algorithm  will  terminate  after  at  most  n  pivots.  Notice  that  (3)  is  defined  by 
the  matrix  M  whereas  (16)  is  by  its  transpose  MT. 

An  example  of  a  vector  p  >  0  satisfying  XTp  >0  is  given  by 

p  "  r  ♦  Ms  (17) 

where  r  and  s  satisfy  (15li),  see  (8J .  More  generally,  the  vector  p  computed  by 


solving  the  system  of  linear  equations 


XTp  -  s 


for  any  positive  right-hand  vector  e  will  have  the  same  required  properties.  Indeed,  the 
fact  that  mt  ia  P  implies  that  XT  is  itself  Minkowski  (see  lemma  8  below).  Hence  the 
solution  to  (17)'  is  p  •  x-T#  >0.  In  any  case,  p  can  be  obtained  in  at  sx>st  0(n3) 


tin*.  Consequently,  by  the  analysis  of  Section  2,  the  parametric  principal  pivoting 
algorithm  will  solve  the  LCP(3)  in  0(n3)  time. 

To  prove  Theorem  3,  we  quote  the  lemma  below  which  summarizes  two  useful  properties  of 
a  hidden  Minkowski  matrix.  A  proof  of  the  lemma  can  be  found  in  [24] . 

Lemma  8.  Let  M,  X  and  Y  be  as  given  in  Theorem  3.  Then  for  any  index  set  L, 

(i)  m£l(X/Xxx)  -  (W/Xjgj) 

where  X  is  the  complement  of  L  and 


LL 

X_ 

XL 


‘LX 

XX 


) . 


(ii)  The  matrix  W  is  Minkowski.  (In  particular,  so  are  X  and  Y.) 

Proof  of  Theorem  3.  We  first  remark  that  if  XTp  >  0,  then  for  any  complementary  index 
sets  L  and  X, 

'*T'/<xT>xx>Pl  >  0  • 

From  Lesmu  8(1),  we  obtain 

(MT)LL  -  (W/X^HX/X^)-’ 

which  implies 

(Mll)'1  -  (W/Xkk)_T(X/Xkk)T 

Thus,  it  follows  that 

<"ll)_1Pl  ■  <w/xxx>"T(x/xxx>TPl  *  0 

because  (W/X^)  is  Minkowski  (implied  by  Leimna  8(ii))  and  thus  has  a  nonnegative  inverse, 
and  (X/Xja?)T  “  (XT/(XT)KK).  This  completes  the  proof. 

The  proceeding  discussion  shows  that  in  oeneral  the  parametric  vector  p  can  be 
calculated  from  either  (17)  or  (17)'.  In  the  Corollary  below,  we  identify  two  classes  of 
matrices  M  for  which  the  vector  p  is  available  trivially. 

Corollary  1.  (i)  If  M  «  YT  +  abT  where  Y  is  a  Minkowski  matrix  and  a  and  b  are 

positive  vactors,  then  p  ■  a  satisfies  condition  (5). 

(ii)  If  M  has  positive  diagonal  entries  and  is  strictly  row  diagonally  dominant, 

i  •  ®  e  f 
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Mii  >  i  l"iJ  a11  1  ' 

j*i  } 

then  the  vector  p  »  (pA)  defined  by 

Pi  “  Mli  +  .  1  n  Mij  aU  1 

satisfies  condition  (5). 

Proof.  It  is  known  that  a  matrix  M  satisfying  either  (i>  or  (ii)  is  hidden  Minkowski 
(see  [8]  e.g.).  It  is  also  obvious  that  the  vector  p  in  either  case  is  positive.  Thus 
it  remains  to  verify  that  XTp  >  0  where  X  is  as  given  in  Theorem  3.  In  case  (1),  we 
have 

Mt  -  YU  +  Y_1baT)  . 

Thus 


XT  =  (I  +  Y” 1  baT )  ~T 


I  - 


T  -T 
ab  r  r 

T  -T 

1  +  b  Y  a 


Hence,  it  follows  that 

XTa  -  a/(1  +  ***"*»)  >  0  . 

In  case  (ii),  we  may  write  (see  (8]) 

M  <=  2A  -  B 

where  B  =  fi  is  the  comparison  matrix  of  M  and  A  «  (M  +  H)/2.  It  is  easy  to  show  that 
the  required  XT  is  given  by  (see  [8] ) 

XT  -  BA-1  . 

With  the  vector  p  defined  as  specified,  we  easily  deduce  that  A_1p  is  the  vector  of  all 
T 

ones.  Thus  X  p  >  0  because  M  is  strictly  row  diagonally  dominant. 

Remark .  The  matrix  M  arising  from  the  concave  regression  problem  (cf.  (8)’)  provides 
another  example  for  which  the  parametric  vector  p  is  available  trivially. 

If  M  is  an  H-matrix  with  positive  diagonals  and  if  d  is  a  positive  vector  such 
that  fid  >  0,  then  the  same  proof  of  case  (ii)  in  the  above  Corollary  shows  that  the 
vector  p  *  (M  +  fi)d/2  satisfies  condition  (5). 
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5.  OH  LBUCB'S  METHOD 


It  is  rather  evident  that  the  parametric  principal  pivoting  algorithm  presented  in 
Section  2  is  intimately  related  to  Lemke's  well-known  almost  complementary  pivoting 
algorithm  [16,  19].  Indeed,  in  [21],  McCammon  pointed  out  that  Lemke's  method  can  be 
implemented  as  a  parametric  pivot  scheme  in  which  the  artificial  variable  is  treated  as  a 
parameter  (see  also  [19]).  McCammon  also  discussed  the  relationship  between  this 
parametric  version  of  Lemke's  method  and  principal  pivoting.  As  a  result  of  such  a 
connection,  it  is  natural  to  ask  whether  the  existence  of  a  positive  vector  p  satisfying 
condition  (5)  will  imply  a  linear  termination  for  Leake's  method  applied  to  a  LCP  with  a 
matrix  which  is  not  necessarily  P.  The  result  below  gives  an  affirmative  answer  to  this 
question.  Recall  that  a  matrix  M  is  nondegenerate  if  all  its  principal  submatrices  are 
nonsingular. 

Theorem  4.  Let  M  be  an  n  *  n  nondegenerate  matrix.  Suppose  that  there  is  a  positive 
vector  p  satisfying  condition  (5).  Then  Lemke's  almost  complementary  pivoting  algorithm 
using  p  as  the  artificial  vector,  will  terminate  with  a  desired  solution  to  the  LCP(3) 
after  at  moat  n  ♦  1  pivots. 

Proof.  Consider  a  current  Iteration  (after  the  first)  of  Lemke's  method.  We  have 
available  an  index  set  L  corresponding  to  the  basic  x-variables  and  an  index  t  ♦  L  such 
that  {yt»xtI  is  the  nonbasic  pair.  The  canonical  tableau  may  be  written  as  (only  the  key 
entries  are  displayed) 


e 

yJ 


yL 


yt 


x 


t 


x 


J 


LL 

tL 


(17) 


where  J  is  the  complement  of  (t)  u  L. 

Assume  that  yt  has  just  become  nonbasic  so  that  xt  is  the  incoming  variable.  We 
claim  that  condition  (5)  implies  that  the  next  pivot  will  not  occur  in  an  xL-row.  Indeed, 
after  an  easy  computation,  it  is  easy  to  verify  that  the  (xL,xt)-entry  in  the  above 
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tableau  is  given  more  explicitly  by 


At '  \iAXt 


Pt  "  WPL 


LLtt,  -1  _  -1 

-1  '  HLLPL  MLLMLt  ' 


(18) 


-1 


(The  fact  that  M  is  nondegenerate  (implying  M  exists)  and  the  nonsingularity  of  the 

LL 


basis  matrix 


B  -  PL) 

Al  Pt 


guarantee  the  nonvanishing  of  the  denominator.  The  nonsingularity  of  the  basis  B  is  in 
turn  guaranteed  by  the  pivot  operations.)  By  (5),  the  vector 


(;Li  -  yrc-) . » . 


V  "« 


It  is  easy  to  show  that 


-  .  ‘I  .  /  Pt  ~  MtLMLLPL  v  -1 

PL  mllpl  ’  >  mll  : 

Mtt  *  \lAlAt 


Lt 


Pt  ”  <Pt  *  MtLVPL)/(Mtt  ‘  \lA>Lt>  * 

(Again,  the  nondegeneracy  of  M  implies  that  the  denominator  in  the  above  two  expressions 
is  nonzero.)  Thus,  it  follows  from  (18)  that  the  (xL,xt)-entry  in  tableau  (17)  is  given  by 
the  vector  P^/p^  which  is  nonnegative.  Consequently,  the  increase  of  xfc  will  not 
decrease  the  values  of  the  already-basic  xL-variableB.  Therefore,  the  next  pivot  will 
occur  either  in  the  0-row  (in  which  case  a  solution  to  the  1CP(3)  is  obtained)  or  in  a 
yj-row  (in  which  case  the  index  set  L  increases  by  one  element  and  the  argument  just 
given  repeats  itself). 

Next,  we  show  that  the  (0,xt)-entry  in  tableau  (17)  is  negative.  Indeed,  this  entry 
is  -1/pt.  Thus  lt  is  negative.  Consequently,  the  increase  of  xfc  is  bounded  above  by 
6.  Hence,  termination  on  a  secondary  ray  can  not  occur. 
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Summarizing,  we  have  proven  that  once  an  x-variable  has  become  basic,  it  will  stay 
basic  until  termination  occurs.  Since  there  are  only  n  x-variables,  the  algorithm 
terminates  after  at  most  n  +  1  pivots.  Since  termination  on  a  ray  is  ruled  out,  a 
desired  solution  to  the  LCP(3)  will  be  obtained.  This  establishes  the  theorem. 

Remark .  i)  As  in  Theorem  1,  no  nondegeneracy  assumption  is  needed  to  prove  Theorem  4. 
ii)  The  matrix 


satisfies  the  assumptions  of  Theorem  4  (with  p  =  (1,1)T).  But  it  is  not  P. 

Theorem  4  may  be  considered  an  extension  of  Theorem  1  to  the  case  of  a  non-P  matrix. 
Proofs  to  both  theorems  are  based  on  the  same  key  idea  that  an  x-variable  once  becomes 
basic,  stays  basic.  At  present,  it  is  not  clear  to  us  what  class  of  matrices  M  (besides 
those  considered  in  the  last  two  sections)  will  produce  an  easily  calculable  vector  p 
satisfying  the  required  properties.  We  leave  this  as  an  open  question  for  further 
investigation. 

It  is  interesting  to  contrast  Theorem  4  with  the  worst-case  studies  of  (12,  22].  In 
these  earlier  studies,  examples  have  been  presented  which  demonstrate  that  Lemke'a  method 
can  require  an  exponential  number  of  pivots.  On  the  other  hand,  Theorem  4  guarantees  that 
for  certain  class  of  problems,  the  polynomial-time  complexity  of  Lemke's  method  can  be 
established.  Although  a  complete  knowledge  of  such  problems  is  not  yet  available,  the 
examples  in  Sections  3  and  4,  together  with  those  that  are  previously  known  should  have 
amply  demonstrated  that  the  class  is  non-void  and  indeed  contains  some  very  interesting 
applications  of  the  LCP. 
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